Structure-dependent amplification for denoising and background correction in Fourier ptychographic microscopy

Fourier Ptychographic Microscopy (FPM) allows high resolution imaging using iterative phase retrieval to recover an estimate of the complex object from a series of images captured under oblique illumination. FPM is particularly sensitive to noise and uncorrected background signals as it relies on combining information from brightfield and noisy darkfield (DF) images. In this article we consider the impact of different noise sources in FPM and show that inadequate removal of the DF background signal and associated noise are the predominant cause of artefacts in reconstructed images. We propose a simple solution to FPM background correction and denoising that outperforms existing methods in terms of image quality, speed and simplicity, whilst maintaining high spatial resolution and sharpness of the reconstructed image. Our method takes advantage of the data redundancy in real space within the acquired dataset to boost the signal-to-background ratio in the captured DF images, before optimally suppressing background signal. By incorporating differentially denoised images within the classic FPM iterative phase retrieval algorithm, we show that it is possible to achieve efficient removal of background artefacts without suppression of high frequency information. The method is tested using simulated data and experimental images of thin blood films, bone marrow and liver tissue sections. Our approach is non-parametric, requires no prior knowledge of the noise distribution and can be directly applied to other hardware platforms and reconstruction algorithms making it widely applicable in FPM

Comparison of Artificial Intelligence based approaches to cell function prediction

Predicting Retinal Pigment Epithelium (RPE) cell functions in stem cell implants using non-invasive bright field microscopy imaging is a critical task for clinical deployment of stem cell therapies. Such cell function predictions can be carried out using Artificial Intelligence (AI) based models. In this paper we used Traditional Machine Learning (TML) and Deep Learning (DL) based AI models for cell function prediction tasks. TML models depend on feature engineering and DL models perform feature engineering automatically but have higher modeling complexity. This work aims at exploring the tradeoffs between three approaches using TML and DL based models for RPE cell function prediction from microscopy images and at understanding the accuracy relationship between pixel-, cell feature-, and implant label-level accuracies of models. Among the three compared approaches to cell function prediction, the direct approach to cell function prediction from images is slightly more accurate in comparison to indirect approaches using intermediate segmentation and/or feature engineering steps. We also evaluated accuracy variations with respect to model selections (five TML models and two DL models) and model configurations (with and without transfer learning). Finally, we quantified the relationships between segmentation accuracy and the number of samples used for training a model, segmentation accuracy and cell feature error, and cell feature error and accuracy of implant labels. We concluded that for the RPE cell data set, there is a monotonic relationship between the number of training samples and image segmentation accuracy, and between segmentation accuracy and cell feature error, but there is no such a relationship between segmentation accuracy and accuracy of RPE implant labels

Digital refocusing and extended depth of field reconstruction in Fourier ptychographic microscopy

Fourier ptychography microscopy (FPM) is a recently developed microscopic imaging method that allows the recovery of a high-resolution complex image by combining a sequence of bright and darkfield images acquired under inclined illumination. The capacity of FPM for high resolution imaging at low magnification makes it particularly attractive for applications in digital pathology which require imaging of large specimens such as tissue sections and blood films. To date most applications of FPM have been limited to imaging thin samples, simplifying both image reconstruction and analysis. In this work we show that, for samples of intermediate thickness (defined here as less than the depth of field of a raw captured image), numerical propagation of the reconstructed complex field allows effective digital refocusing of FPM images. The results are validated by comparison against images obtained with an equivalent high numerical aperture objective lens. We find that post reconstruction refocusing (PRR) yields images comparable in quality to adding a defocus term to the pupil function within the reconstruction algorithm, while reducing computing time by several orders of magnitude. We apply PRR to visualize FPM images of Giemsa-stained peripheral blood films and present a novel image processing pipeline to construct an effective extended depth of field image which optimally displays the 3D sample structure in a 2D image. We also show how digital refocusing allows effective correction of the chromatic focus shifts inherent to the low magnification objective lenses used in FPM setups, improving the overall quality of color FPM images

Histological and cytological imaging using Fourier ptychographic microscopy

Structural imaging using light microscopy is a cornerstone of histology and cytology. However, the utility of the optical microscope for diagnostic imaging is limited by the fundamental tradeoff between the field of view and spatial resolution and a reliance on exogenous dyes to generate sufficient image contrast. Fourier Ptychographic Microscopy (FPM) is a complex imaging modality with the potential to overcome these limitations by recovering high-resolution images of sample amplitude and phase from a set of low-resolution raw images captured under inclined illumination. In this article we explore the application of FPM to clinical imaging using a simple, low-cost FPM system and simulated and experimental data to explore the influence of both image acquisition parameters and hardware configuration on image quality and imaging throughput. The practical performance of the method is investigated by imaging peripheral blood films and histological tissue sections. We find that, at the cost of increased computational complexity, FPM increases the information capture capacity of the optical microscope significantly, allowing label-free examination and quantification of features such as tissue and cell morphology over large sample areas

Optical mesoscopy, machine learning and computational microscopy enable high information content diagnostic imaging of blood films

Automated image-based assessment of blood films has tremendous potential to support clinical haematology within overstretched healthcare systems. To achieve this, efficient and reliable digital capture of the rich diagnostic information contained within a blood film is a critical first step. However, this is often challenging, and in many cases entirely unfeasible, with the microscopes typically used in haematology due to the fundamental trade-off between magnification and spatial resolution. To address this, we investigated three state-of-the-art approaches to microscopic imaging of blood films which leverage recent advances in optical and computational imaging and analysis to increase the information capture capacity of the optical microscope: optical mesoscopy, which uses a giant microscope objective (Mesolens) to enable high resolution imaging at low magnification; Fourier ptychographic microscopy, a computational imaging method which relies on oblique illumination with a series of LEDs to capture high resolution information; and deep neural networks which can be trained to increase the quality of low magnification, low resolution images. We compare and contrast the performance of these techniques for blood film imaging for the exemplar case of Giemsa-stained peripheral blood smears. Using computational image analysis and shape-based object classification we demonstrate their use for automated analysis of red blood cell morphology and visualization and detection of small blood borne parasites such as the malarial parasite Plasmodium falciparum. Our results demonstrate that these new methods greatly increase the information capturing capacity of the light microscope with transformative potential for haematology and more generally across digital pathology. This article is protected by copyright. All rights reserved

Accurate and interpretable classification of microspectroscopy pixels using artificial neural networks

This paper addresses the problem of classifying materials from microspectroscopy at a pixel level. The challenges lie in identifying discriminatory spectral features and obtaining accurate and interpretable models relating spectra and class labels. We approach the problem by designing a supervised classifier from a tandem of Artificial Neural Network (ANN) models that identify relevant features in raw spectra and achieve high classification accuracy. The tandem of ANN models is meshed with classification rule extraction methods to lower the model complexity and to achieve interpretability of the resulting model. The contribution of the work is in designing each ANN model based on the microspectroscopy hypothesis about a discriminatory feature of a certain target class being composed of a linear combination of spectra. The novelty lies in meshing ANN and decision rule models into a tandem configuration to achieve accurate and interpretable classification results. The proposed method was evaluated using a set of broadband coherent anti-Stokes Raman scattering (BCARS) microscopy cell images (600 000 pixel-level spectra) and a reference four-class rule-based model previously created by biochemical experts. The generated classification rule-based model was on average 85% accurate measured by the DICE pixel label similarity metric, and on average 96% similar to the reference rules measured by the vector cosine metric

Deep learning predicts function of live retinal pigment epithelium from quantitative microscopy.

Increases in the number of cell therapies in the preclinical and clinical phases have prompted the need for reliable and non-invasive assays to validate transplant function in clinical biomanufacturing. We developed a robust characterization methodology composed of quantitative bright-field absorbance microscopy (QBAM) and deep neural networks (DNNs) to non-invasively predict tissue function and cellular donor identity. The methodology was validated using clinical-grade induced pluripotent stem cell derived retinal pigment epithelial cells (iPSC-RPE). QBAM images of iPSC-RPE were used to train DNNs that predicted iPSC-RPE monolayer transepithelial resistance, predicted polarized vascular endothelial growth factor (VEGF) secretion, and matched iPSC-RPE monolayers to the stem cell donors. DNN predictions were supplemented with traditional machine learning algorithms that identified shape and texture features of single cells that were used to predict tissue function and iPSC donor identity. These results demonstrate non-invasive cell therapy characterization can be achieved with QBAM and machine learning

Data-driven malaria prevalence prediction in large densely populated urban holoendemic sub-Saharan West Africa

Over 200 million malaria cases globally lead to half-million deaths annually. The development of malaria prevalence prediction systems to support malaria care pathways has been hindered by lack of data, a tendency towards universal "monolithic" models (one-size-fits-all-regions) and a focus on long lead time predictions. Current systems do not provide short-term local predictions at an accuracy suitable for deployment in clinical practice. Here we show a data-driven approach that reliably produces one-month-ahead prevalence prediction within a densely populated all-year-round malaria metropolis of over 3.5 million inhabitants situated in Nigeria which has one of the largest global burdens of P. falciparum malaria. We estimate one-month-ahead prevalence in a unique 22-years prospective regional dataset of > 9 × 10^{4} participants attending our healthcare services. Our system agrees with both magnitude and direction of the prediction on validation data achieving MAE ≤ 6 × 10^{-2}, MSE ≤ 7 × 10^{-3}, PCC (median 0.63, IQR 0.3) and with more than 80% of estimates within a (+ 0.1 to - 0.05) error-tolerance range which is clinically relevant for decision-support in our holoendemic setting. Our data-driven approach could facilitate healthcare systems to harness their own data to support local malaria care pathways

Impact of motion compensation and partial volume correction for ¹⁸F-NaF PET/CT imaging of coronary plaque

Recent studies have suggested that ¹⁸F-NaF-PET enables visualization and quantification of plaque micro-calcification in the coronary tree. However, PET imaging of plaque calcification in the coronary arteries is challenging because of the respiratory and cardiac motion as well as partial volume effects. The objective of this work is to implement an image reconstruction framework, which incorporates compensation for respiratory as well as cardiac motion (MoCo) and partial volume correction (PVC), for cardiac ¹⁸F-NaF PET imaging in PET/CT. We evaluated the effect of MoCo and PVC on the quantification of vulnerable plaques in the coronary arteries. Realistic simulations (Biograph TPTV, Biograph mCT) and phantom acquisitions (Biograph mCT) were used for these evaluations. Different uptake values in the calcified plaques were evaluated in the simulations, while three "plaque-type" lesions of 36, 31 and 18 mm³ were included in the phantom experiments. After validation, the MoCo and PVC methods were applied in four pilot NaF-PET patient studies. In all cases, the MoCo-based image reconstruction was performed using the STIR software. The PVC was obtained from a local projection (LP) method, previously evaluated in preclinical and clinical PET. The results obtained show a significant increase of the measured lesion-to-background ratios (LBR) in the MoCo+PVC images. These ratios were further enhanced when using directly the tissue-activities from the LP method, making this approach more suitable for the quantitative evaluation of coronary plaques. When using the LP method on the MoCo images, LBR increased between 200% and 1119% in the simulated data, between 212% and 614% in the phantom experiments and between 46% and 373% in the plaques with positive uptake observed in the pilot patients. In conclusion, we have built and validated a STIR framework incorporating MoCo and PVC for ¹⁸NaF PET imaging of coronary plaques. First results indicate an improved quantification of plaque-type lesions